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Abstract 

Earlier research in iob shop scheduling has demonstrated the advantages of opportunistically combining order-based 
and ^ourc^-based^ sc hed u h n g techniques. In this paper we investigate an even more flexible approach where each 

itself. Heuristics to opportunistically select die next decision point ton , which 

to focus attention (i e variable ordering heuristics) and the next decision to be tned at this point (i.e., value ordering 
SSnrteo'iTi probabilistically account fo, bolh activity precedence and reduce reriur remen l 
interactions Preliminary experimental results indicate lhat die variable ordering heuristic grrady increases search 
eflST While least constraining value ordering heuristics have been advocated m the bterame[7) our 
experimental results suggest that other value ordering heunsucs combined with our vanable-ordenng heurrsuc can 
produce much better schedules without significantly increasing search. 


1. Introduction 

We are concerned with the issue of how to opportunistically focus an incremental job shop scheduler s attenuon on 
the most critical decision points ( variable ordering heuristics) and the most promising decisions at these points (value 
ordering heuristics) in order to reduce search and improve the quality of the resulting schedule. 

So called order-based and resource-based scheduling techniques have been at the origin of several incremental 
scheduling algorithms. In an order-based approach, each order is considered a single decision point, i.e. orders are 
prioritized and scheduled one by one. In a resource-based approach, resources are rated according to their projected 
levels of demand. Resources are then scheduled one by one, starting with the ones that have the highest demand. 
Order-based scheduling has proven to be a viable paradigm in problems where slack (i.e. temporal precedence 
interactions) is the dominating factor. On the other hand, resource-based scheduling is likely to perform better in 
situations where resource contention (i.e. resource requirement interactions) is critical. Neither approach is perfect. 
Indeed a lot of real life scheduling problems contain a mix of critical orders and critical resources. In the past few 
years it has become clear that in order to perform well in a wider class of problems, schedulers need the ability to 
opportunistically switch from one approach to the other. The OP1S [15, 12, 16] scheduler was the first scheduler to 
combine bolh approaches. OPIS uses demand thresholds to identify bottleneck resources. Typically, when a 
bottleneck resource is detected, all activities requiring that resource and that have not yet been scheduled will be 
scheduled. When all bottleneck resources have been scheduled, OPIS switches to order-based scheduling. While in 
order scheduling mode, OPIS may detect the appearance of new bottleneck resources and switch back to its resource 
scheduling mode. Even such an approach has its shortcomings as the criticalities of the activities requiring a 
bottleneck resource or belonging to a critical order arc not homogeneous, i.e. some of these activities may not be that 
critical. This consideration led us to the investigation or a new scheduling framework where the decision points are 
no longer entire resources or entire orders but instead where each activity is a decision point in its own right. Within 
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advantages of both order-based aln^ “ t0 ^“^cally combine 

==sss=== 

2. The Model 

to. specifics , parual ordering among to acii.iitac'o^aton” u jjj 
rcqunc one or several resources R u ( Is i <p„) . for each of which .here may be several akemalivL R (,<, So 7 
We will use s, t . and Ru k to rcspccd.ely denote A.’s shirt dmc. end time, L dumdon. V ° ' ^ ’ 


Wc view the scheduling problem as a constraint satisfaction problem (CSP). 


illSI^s 

for all 13 of Allen s temporal constraints [1], Capacity constraims restrict to number of mservaZs of a ZZ 

° f reS0Urc °' FOt “ "*■ ° f SimP ' iC “ y - ” "" “ “* *«*' “■ a “ 

Addibonally our model allows fo, preferences on aclivity siar, limes and dumuous as well as on die resources to, 

ST“ 7 7 ' CrCn “ S m0dCl0d W,,h “<>"’• These funedons map l h v^aUe s Zl2 

values omo uuhtics ranging be, ween 0 and >. Preferences on acdvby sian dmes and duutoTlwTto 


^ ”" y For i, .wo «UviO.. mw. A , b»d, ^.ui^ . „u,uc 

2 This is not necessarily the order’s due dale. 
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a (separable) objective function to be maximized. 


3. The Approach 


«■*» «. «— - - — — *■ « *— »*: -«7rr 

acSrrS — »d possibly ite dmaUon. Tta schedule is buil. mcementelly 
an activity to be scheduled and a reservation for that activity (i.e. start time, resources and possibly duration). Every 
rr^Sduled. new consents are added fo th. inilial scheduling problem, and propagamd. If an 
inconsistency is detected during propagation, the system backtracks. The process stops tether when all actrvmes have 
been successfully scheduled or when all possible alternatives have been tried without success. 

The efficiency of such an incremental approach critically relies on the order in which activities ^ sch^andon 
the order in which possible reservations are tried for each activity. Indeed, because job-shop scheduling is NP-har 
search for a schedule may require exponential time in the worst case. Both empirical and analytical ^dies of 
constraint satisfaction problems reported in [6, 5, 13, 9, 10, 11, 17] indicate however that, on the average, search can 
significantly be reduced if always focused on the most critical decision points and the most promismg decisio 
these points. Such techniques are often referred to [2] as variable and value ordering heuristics. 

In this paper we assume that critical activities are the ones whose good (overall) reservations are most likely to 
become unavailable if one were to start scheduling other activities first. In general reservations may become 
unavailable because of operation precedence constraints, because of resource ^ 

combinations of both types of constraints. Clearly criticality measures are probabilistic in nature as the 
computations require probabilistic assumptions on the values that will be assigned later on to each variable^, the 
ZZEL tha. will later on bo assigned ro each unscheduled activity). In die »ex, subsecuou we muoduce 
probabilistic framework that accounts for the interactions of start time, duration and resource preferences mdu y 
Lh activity precedence and resource capacity constraints. We will use this model throughout the remainder of the 
paper to define several variable and value ordering heuristics for activity-based scheduling. 


3 2 A Probabilistic Framework to Account for Constraint Interactions 
' In this subsection we outline’ a probabilistic model that we will use throughout the remainder of Ihe paper to define 
several variable and value ordering heuristics for activity-based joh-shop scheduling. We justify the model by its 
ability to account for bod, intra-order and intcr-order interactions and by its relatively low computaltonal mqummente 
For die sake of simplicity, the formulas presented in this paper assume fixed duration activates. Similar formulas can 
be deduced when dealing with variable duration activities. 

In our model a priori probability distributions are assumed for the possible start times and resource 8 of each 
unscheduled activity. These probabilities are then refined to account for the interactions induced by the proble 
constraints (i.e. both intra-order and intcr-order interactions). Finally the results of this propagation process are 
combined to identify critical activities and promising reservations for these activities. In their simplest form the 
priori probability distributions are uniform. This amounts to assuming that, a prion, all possible reservations are 


3 A more detailed description can be found in [14], 
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^nShenHshce,^^ » - — *~ i. 

co«' * * “ - 00 ". /or the interactions of the problem 

within each order, thereby accounting for intra-order inteJcholTand ' | £ r0bab ' l “ > d ™'buttons are first propagated 
interactions. Accounting simultaneously for horh • ’ d lhen across orders 10 account for inter-order 

theoretical point of view J2ZT , ““T 0 ” inted ^ <■“*>* « ">och from a 

which a set of .Cvitics T' 7 ‘ T ° f f « ““ — *« - -ys in 

accounUng for intra-order and inter-order interactions one Bread ""d * °i. lhCSe acuviues< ' Instead - by separately 
The propagation results can always be aTartii^^^ , l ^J^^^ n ^^ 0rn,a< *' 

Concretely, once the a priori distributions have been generated our «««,»«• 
steps: 8 e atcd ’ ° Propagation process involves the following two 

1 . 

‘SSSff* ^ir^^SStih^d^r “ *“>“"* precedmtce 

Umes of each activity the probability lhauhesc start tim^^n!!! ass °^! ate to 1,16 Possible start 
not result in the violation of an activity nrornrwi U - ** med by *■* scheduler and will 

«* a ~ own^ejme^^nce? aJdThence 

P p ^;!i[ y y i ^;“ 8 «"*': 0 "T u Tn;; 2 irr s “ r ' ori ^ T,frS 

probabilistic contribution of //to the demand for T^aTdmp^f represents the 

checked for consistency with respect^ m 2 " S kij T U lf My reservati °"S were only 
to /)*. (,) as A k 's (probabilistic) individual dcmand fS^SieT^" 15 ' ^ °" W ® WU1 refer 

Ume) to reflect the^obabihsd/demand foeari res^ ^ a J 5gre< ? ated (i : e - summed at each point in 
demand densities may get larger than one over enm esource in foncaon of time. The resulting aggregate 
from which they originate have not been checked forcon^kte ° [txmQ ' as ^ “dividual demand densities 
High demand for a Source “ ““ consents, 

from - “ ^TrsaLsastss 

0ne - * » — * 

reservation will be available. The availability nrobabilitv of * rKen ' illlon •* avaN *le and that no better 

the reservation does no. vioiate any ^ ‘^“e ^ *“ “ ^ P-*-** •» 

These probabilides can then be combined into new a priori start time “"'"‘T SCd “° n 5 lo ' dcails )- 
propagation process can be carried out all over again Th^ ^ resource probability distributions, and the 

been obtained without iterating thHco ' 0 ^ T”" ^ ^ P»P« have all 

probability distributions obtained after iterating die propagation a vmi^lTnumber of^mw! e ’ 1Perimems wilh 


as ss ssastsi rasrr rr - » - - » 

satisfy .U acuvuy precedence and resource capacity constraints is in gc^d ^1°^ * * * Me f ° r a “ Ihe activilics 
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Notations 


In the remainder of the paper the following notations will be used: 

. pPRlOR( st - t) will den ote the a priori probability that A k will be scheduled to start at time t, 

. pPOST( stk= i) w iu be the a posteriori probability that A k starts at time t, i.e. after accounting for activity 
precedence constraints, 

• represents the same probability distribution after it has been normalized to express that A k 
will start exactly once, 

• £>.-</) represents A k s individual demand for R klJ at time t, and 

KIJ 

• D a o gr (t) will denote the aggregate demand for R ki j at time t. 


4 ARR: A Variable Ordering Heuristic Based on Activity Resource Reliance 

’aRR, the variable ordering heuristic that we study in this paper, consists in looking for the resource/ume mterv 
pair that is the most contended for and the activity that relies most on the possession of that resource over that time 
interval. This activity is selected as the most critical one and hence is the next one to be scheduled. 

The intuition behind this heuristic is the following. If activities that critically rely on the possession of highly 
contendedr^ources were not scheduled first, it is very likely that, by die time the scheduler would turn its attention to 
them, the reservations that are the most appropriate for these activiues would no longer be available. 

The aggregate demand densities introduced in subsection 3.2 are used to identify the most demanded resource/time- 
interval pair. The activity that contributes most to the demand for the resource over the ume interval (i.e the activity 
with the largest individual demand for the resource over the time interval) is interpreted as the one that relies most on 
the possession of that resource. Indeed the total demand of an activity A k for one of its resource requirements is 
equal to A/s duration and is distributed over the different alternatives, R kij , for that resource, and over the different 
possible times when A k can be carried out. Consequently activities with a lot of slack or several resource alternatives 
tend to have fairly small individual demand densities at any moment in ume. They rely less on the possession of 
resource at any moment in time than activities with less slack and/or fewer resource alternatives. This allows ARR to 
account not only for inter-order interactions but also for intra-order interactions. 

The advantage of this approach lies in its relative simplicity: look for the most critical resource/Ume-interval pair 
and select the activity that relies most on it. One may however contend that this heurisuc does not consider slack as an 
independent component to activity criticality. Instead slack is only accounted for via resource contenuon. Another 
possible problem with this heuristic is that it only considers resource reliance with respect to the most contended 
resource. In general an activity A k may require several resources R*, Rigorously, A/ s criticality should therefore 
account for each of these resources. It should account for the contention for each of the possible altemaUves R aj for 
these resources R h , and the reliance of A k on the possession of each of these altemaUves R*,, Computation of such a 
criticality measure is likely however to be more expensive. 


5. Three Value Ordering Heuristics 

In the experiments that we ran, we considered the following three value-ordering heuristics. 


5.1. LCV: A Least Constraining Value Ordering Heuristic 
Least constraining value ordering heuristics arc known for being very good at reducing search [6 2]. Simi ar 
heuristics have also been proposed for scheduling, even when viewed as an optimization problem. [7], for instance, 
suggests the use of a least constraining value ordering heuristic as a primary criterion for selecting a reservauon for an 
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LCV iS a ,east cons training value ordering heuristic where every reservation [ {^=t. R , R R. . )],{ oran 

activity A k , is rated according to the probability RESER V-A VAIL( st =t R Jt \ thJ t * m 

oimf . ... nv/u ^ st k-^ K k\j>-J<kp h ] ) ^at it would not conflict with 

other activity s reservation, if one were to first schedule all the other remaining activities The reservation with the 
largest such probability is interpreted as the least constraining one. the teservatton with the 

hum, mode,, we express HTUnx ) as Urn pmdnct of dm probability Out. r„« wil, mn 

resu in e vtoalion of an activity precedence constraint and the conditional probability that each resource 

*?■ *4. to ava,lablc bclw “ n ‘ “ d **• hat sr»=t does not result in die violation of an 

activity precedence constraint : 

RESERV-AVAm.st k =t,R kXjr .Ji kpJ ) 

P P0ST (st k =L) ^ 

= pPPlOR ( l ) X 11 RESOURCE-AVAlLiR^u+du, ) 

K lC J ***« 

'* ‘ +dUk) iS thC conditionaI Probability that/?*., will be available between / and t+du 
given that */*=/ does not result in the violation of an acti vity precedence constant. * 

We wiU approximate the (conditional) probability tha, % will be available a. some time r for activity d, with 
When approximaung RESOURCE-AVAIU.R one has d> be careful no, „ come up wid. mo 

pessimistic an esdmale. Indeed it is temphng to assume that the (conditional) probability that R wiU be available for 
d, between , and rvdu, is given by die product of -jgL over all possible shut times t between , and r*fc, 

Dep ending on whether time is discrete or not, this product* would be finite or infinite. In either case the amroxirmrinn 
would be too pcsstmisdc. Indeed this would be tantamount to supposing dm. dm aedvides that comribuT^ft) 

0 “;:^ “ 7 mS - ' ' lha ' ^ aCUV “ ieS “ - - T without C 

or TdSt. Instead, in order to account for die duradon of these aedvides. we will assume that each resoLe R is 

7 7 Z 7 T Cn “ ° f Tt“e ° f ‘"' ra “ 0n AVGVU) ' Whe ' e AVGm “ ** avera 8 e duradon of dm acdvtes 

" " - A, can secure a 

D (r\ 

RESOURCE-AVAIL(R kij , t, t+du k ) = {AVG(- -t L)]AVG(du) 

D 7* r v 

where AVG( ) i S simply the average of - ^ -taken between t and t+du^ 
d r W d r s (t) *• 
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5 2. HC: A Hill-Climbing Value Ordering Heuristic 
The second value ordering heuristic that we tested simply consists in ranking an activity s possible rese™uons 
according to their utilities, i.e. preferences. Reservations with the highest preferences are the first ones to be in 


5.3. INT: An Intermediate Value Ordering Heuristic 

Our third value ordering heuristic combines features from the previous two. Each reservation is rated according to 
the probability that it would be available and that no better reservation would be available, if one were to fust schedu e 
all the other remaining activities. 


6. Preliminary Experimental Results ...... 

A testbed was implemented that allows for experimentation with a variety of variable and value ordering heunsucs 
based on the probabilistic framework described in subsection 3.2. The system is implemented in Knowledge Craft 
running on top of Common Lisp, and can be run either on a MICROVAX 3200 or on a VAX 8800 under VMS. 

We performed some preliminary experiments to evaluate the four heuristics presented in this paper. These 
experiments were run on a set of 38 scheduling problems, involving between 3 and 5 orders and a total number of 
activities ranging between 10 and 20. The problems involved 3 or 4 resources. They involved only acuviues with a 
unique resource requirement (R kl ), for which there were one or several alternatives (**,;)• Problems with both equal y 
preferred and non equally preferred resource alternatives were included. The scheduling problems were built to reflect 
a variety of demand profiles: localized bottlenecks at the beginning, middle, and end of the problem span, global 
bottlenecks spanning the whole duration of the scheduling problems, and auxiliary bottlenecks were all included. 
Three different types of start time utility functions were allowed: all start times (between the earliest and latest start 
times) are equally preferred, late start times are preferred, and triangular start utility functions with a peak 
corresponding to the due date (minus the duration of the activity). Triangular utility functions were only assigned to 
the last activities of some orders. Time was discretized and a granularity equal to the third of the smallest activity 
duration was used. A discrete version of the formulas presented in this paper was used to compute the necessary 
probability distributions. The probabilities were computed using biased a priori probability distributions obtained by 
normalizing the utility functions over the domain of possible values of each variable. The granularity of the time 
intervals used for the ARR variable ordering heuristic varied from one resource to the other and was selected to be 
equal to the duration of the shortest activity requiring the resource. 


Preliminary Experimental Results 
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Figure 6-lt Average search efficiencies and schedule values for 5 combinations 

of variable and value ordering heuristics run on a preliminary set of 

38 scheduling problems. The standard deviations appear between parentheses. 

The experiments were measured along two dimensions: search efficiency (i.e. number of operations to schedule over 
number of search states generated) and global utility of the solution as defined by a normalized objective function. 
The normalized objective functions were built so that the best possible schedules that could be built without checking 
for constraint violation would have a global value of 1. There was no guarantee however that a feasible schedule with 
global value of 1 could be built. In the ideal case the search would be performed without backtracking, and the 
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niunber of search states generated would be equal to the number of activities to schedule (i.e. efficiency of 1) The 

from o tr r ,s r difficult to asscrt 35 thc vaiue ° f *** ° bjecuve funcu ° n f ° r ** Led 

lot be " ‘k ? " 30(1 WaS T i0 m ° St Ca$CS Sma,,Cr than L For «“* reason the values of the schedules should 

colL f h C , meaSUrCS ' tHCy Sh ° Uld ° nly ^ USCd t0 ““"P™ ** relative perfonnances of the 

combinations of heuristics that we tried. 

ofL^T 6 ‘1 reP °? thC aVerage SCarCh Cffidencics «* «***> values obtained with five combinations 
of variable and value ordering heuristics (for a total of 190 experiments). Standard deviations are provided between 

parentheses. RAND denotes a random variable ordering heuristic, where the next activity to be scheduled is selected 

srs sea,ch was s,opped when " w °“ ,d ■»*** so 

r “ l ° USed in 12 ° f 38 “■***"“• " « not have to be need for any 

of the other heuristics. The average search efficiency of RAND&HC is therefore even worse than 0 47 Because search 

n d . te , mi " at ! in . aIm ° St 3 third of the runs with RAND&HC, no good estimate of the value of the schedules 
produced by this heuristic could be obtained. scneouies 


7. Discussion 

The results reported in Figure 6-1 clearly indicate the importance of a good variable ordering heuristic to increase 
search efficiency (e.g. ARR&HC vs. RAND&HC). They also indicate that a least constraining vatoeorderin^g heuristic 

^R&LCv1 P I ih 3 POOr 7'T ° rderin8 hCUriStiC (Cg - RAND&HC vs. RAND&LCV and RAND&LCV vs. 
hnih r 1 K ; r examp es that we ran 1,10 ARR variable ordering heuristic and the LCV value ordering heurisfics 
both contributed to limit search. The quality of the schedules produced by LCV is however very poor when cZI^ 

to die other two value ordering heuristics (ARR&HC or ARR&INT vs. ARR&LCV). In particular ARR&INT 

StTj “ Tf “ AR f^ CV “ * 35 * of — * in concerned („e2 of 

in any of the 38 examples) but produced much better schedules. Even a simple value ordering heuristic like HC 

TT °' b “ k i raCkin8 wh ' n ““l" » iUl “nr triable ordering heuristic (*e ARR&HC). 
ARR Th P f / bCSt SChedules {dthough 11 squired more search than INT and LCV, when coupled with 
ARR. There seems therefore to be a tradeoff between the amount of search performed and the quality of the resulting 
solution. If little ume is available to come up with a solution the most promising values may be the le^t 12 
ones as they are the least likely to result in backtracking. On the other hand, when there 

may consider looking at riskier values if they are likely to produce better solutions. A value ordering heuristic could 
accordingly be designed that accounts for the time available to find a schedule. 

8. Concluding Remarks 

In this paper, we have investigated an activity-based approach to scheduling. Because of its greater flexibility such 
pproach is expected to allow for the construction of better schedules than approaches using order-based or 
resource-based scheduling or even combinations of the two. The price to pay for this flexibility is the rotential 
overhead involved in the selection of the next decision point on which to focus attention While order baL and 
resource-based scheduling typically require only the compulation of criticality measures for each order or resource in 

each of .h"’ ^ aCUVlty ' baSed SChcduIing a PP r °ach may potentially require the computation of similar measures for 
e*h of the activities to be scheduled. In the simplest scenario, these measures need moreover to be recommit 

time a new activity has been scheduled. It is therefore important that the computation of these m LZTcZZ 

* rClatlVely Cheap com Putalional cost. One may also consider scenarios where several activities are 
scheduled before new criticality measures are computed. 305 

• , We , haVe P A ?f ntCd 3 Pr0babilistic f ramework that successively accounts for both intra-order and inter-order 

interactions. Although such a two-step propagation involves a slight loss of precision in the way it accounts for 

interactions, it has the advantage of having a relatively low computational cost [14]. More accurate probability 
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distributions may always be obtained by iterating the propagation process. Our probabilisuc framework allows or e 
definition of a variety of variable and value ordering heuristics. In this paper, we have studied a simple variable- 
ordering heuristic, ARR, that looks for the most contended resource/time interval pair and the acuvity that relies the 
most on the possession of that resource/time interval pair. Preliminary experiments with the heuristic indicate that it 
greatly contributes to increasing search efficiency. Additionally our experiments with three value ordering heuristics 
seem to indicate that least constraining value odering heuristics such as the one advocated in [7] may not be the only 
viable way to maintain search at an acceptable level. Instead, in our experiments, other value ordering heuristics, 
when coupled with our variable ordering heuristic, produced much better schedules without significantly increasing 

search. 

Our variable ordering heuristic is not perfect. For instance it measures activity criticality only with respect to one 
resource (the most contended resource/time interval pair). While the heuristic performed well in problems where each 
activity requires only one resource (for which there may or may not be alternatives), it may not be as effective for 
activities requiring several resources. We are currently looking at other variable ordenng and value ordering 
heuristics. We are also pursuing our experiments with the heuristics presented in this paper. In particular we still have 
to study the behavior of these heuristics on larger scheduling problems (i.e. more than 100 activities). 

Our long term interest is in the identification of a set of (texture) measures characterizing the search space, that can 
be used to both structure and guide search in that space. Measures of variable criticality (variable ordering heuristics) 
and estimates of value goodness (value ordering heuristics) are examples of such measures [4], 
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